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METHOD OF SPATIALLY FILTERING DIGITAL IMAGE FOR NOISE 
REMOVAL, NOISE ESTIMATATION OR DIGITAL IMAGE 

ENHANCEMENT 
FIELD OF INVENTION 

5 The present invention relates to spatially filtering digital images for 

noise removal, noise estimation or digital image enhancement. 

BACKGROUND OF THE INVENTION 
Some digital image processing applications designed to enhance 
the appearance of digital images take explicit advantage of the noise 

10 characteristics associated with the source digital images. For example, Keyes et 
al. in commonly-assigned U.S. Patent No. 6,1 18,906 describe a method of 
sharpening digital images which includes the steps of measuring the noise 
components in the digital image with a noise estimation system to generate noise 
estimates and sharpening the digital image with an image sharpening system 

15 which uses the noise estimates. Similarly, digital imaging applications have 

incorporated automatic noise estimation methods for the purpose of reducing the 
noise in the processed digital images as in the method described by Anderson et 
al. in U.S. Patent No. 5,809,178. 

In commonly-assigned U.S. Patent No. 5,923,775, Snyder et al. 

20 disclose a method of image processing which includes a step of estimating the 
noise characteristics of a digital image and using the estimates of the noise 
characteristics in conjunction with a noise removal system to reduce the amount of 
noise in the digital image. The method described by Snyder et al. is designed to 
work for individual digital images and includes a multiple step process for the 

25 noise characteristics estimation procedure. A first residual signal is formed from 
the digital image obtained by applying a spatial filter. This first residual is 
analyzed to form a mask signal which determines what regions of the digital 
image are more and less likely to contain image structure content. The last step 
includes forming a second residual signal and sampling the second residual signal 

30 in the image regions unlikely to contain image structure as indicated by the first 
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residual signal. The method taught by Snyder et al. requires the use of the mask 
signal to produce accurate noise estimates due to the fact that the spatial filter used 
to calculate the second residual image does not fully filter the image structure 
content. 

5 It is desirable in any noise estimation method to obtain a residual 

signal that is pure noise, with no image structure content. This will lead to more 
accurate estimation of the noise characteristics in the image. Existing techniques 
suffer from the problem of image structure contamination in the residual signal 
used to estimate the noise. In other words, the spatial filter that produces the 
10 residual signal does not fully filter out image structure. The masking technique 
can not fully exclude image structure pixels from the residual signal. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to provide a spatial filtering 
method that yields a residual signal with reduced image structure. 
15 It is a further object of the present invention to provide a method of 

spatial filtering which is particularly suitable for noise removal, noise estimation 
or digital image enhancement. 

These objects are achieved by a method of spatially filtering a 
digital image comprising the steps of: 
20 a) receiving a source digital image including pixels 

corresponding to one or more different colors; 

b) selecting a pixel of interest in the source digital image; 

c) calculating two or more noise free pixel estimates for the 
pixel of interest using pixel values sampled in a local region about the pixel of 

25 interest; 

d) selecting a final noise free pixel estimate for the pixel of 
interest from the noise free pixel estimates; and 

e) repeating steps b) through e) for other pixels in the source 
digital image to provide a spatially filtered digital image. 
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It is an advantage of the present invention that by using the spatial 
filtering technique accurate estimates of the noise present in digital images can be 
produced. It is a further advantage of the present invention that the spatial 
filtering technique can also produce processed digital images with noise removed. 
5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a functional block diagram of the operation of a 
processing arrangement for practicing the present invention; 

FIG. 2 is a functional block diagram of the digital image processor 
shown in FIG. 1 ; 

10 FIG. 3 is a function block diagram of the noise estimation module 

shown in FIG. 2; and 

FIG. 4 is a diagram of the pixels in a local region about the pixel of 
interest used to calculate the noise free pixel estimate. 

DETAILED DESCRIPTION OF THE INVENTION 

1 5 In the following description, a preferred embodiment of the present 

invention will be described as a software program. Those skilled in the art will 
readily recognize that the equivalent of such software can also be constructed in 
hardware. Because image manipulation algorithms and systems are well known, 
the present description will be directed in particular to algorithms and systems 

20 forming part of, or cooperating more directly with, the method in accordance with 
the present invention. Other aspects of such algorithms and systems, and 
hardware and/or software for producing and otherwise processing the image 
signals involved therewith, not specifically shown or described herein can be 
selected from such systems, algorithms, components, and elements known in the 

25 art. Given the description as set forth in the following specification, all software 
implementation thereof is conventional and within the ordinary skill in such arts. 

The present invention can be implemented in computer hardware. 
Referring to FIG. 1, the following description relates to a digital imaging system 
which includes an image capture device 10a, an digital image processor 20, an 

30 image output device 30a, and a general control computer 40. The system can 
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include a monitor device 50 such as a computer console or paper printer. The 
system can also include an input device control 60 for an operator such as a 
keyboard and or mouse pointer. Multiple capture devices 10a, 10b, and 10c are 
shown illustrating that the present invention can be used for digital images derived 
5 from a variety of imaging devices. For example, FIG. 1 can represent a digital 
photoflnishing system where the image capture device 10a is a conventional 
photographic film camera for capturing a scene on color negative or reversal film, 
and a film scanner device for sensing the developed image on the film and 
producing a digital image. Although the term "scanner" can refer to digital 

10 imaging devices that physically scan or move a sensing element past a 

photographic film sample, the present invention also includes photographic film 
scanners and print scanners that employ a stationary image sensing device to 
generate a digital image. The digital image processor 20 provides the means for 
processing the digital images to produce pleasing looking images on the intended 

15 output device or media. Multiple image output devices 30a and 30b are shown 
illustrating that the present invention can be used in conjunction with a variety of 
output devices which can include a digital photographic printer and soft copy 
display. The digital image processor 20 processes the digital image to adjust the 
overall brightness, tone scale, image structure etc. of the digital image in a manner 

20 such that a pleasing looking image is produced by an image output device 30a. 
Those skilled in the art will recognize that the present invention is not limited to 
just these mentioned image processing modules. 

The general control computer 40 shown in FIG. 1 can store the 
present invention as a computer program stored in a computer readable storage 

25 medium, which can include, for example: magnetic storage media such as a 

magnetic disk (such as a floppy disk) or magnetic tape; optical storage media such 
as an optical disc, optical tape, or machine readable bar code; solid state electronic 
storage devices such as random access memory (RAM), or read only memory 
(ROM). The associated computer program implementation of the present 

30 invention can also be stored on any other physical device or medium employed to 
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store a computer program indicated by offline memory device 70. Before 
describing the present invention, it facilitates understanding to note that the 
present invention is preferably utilized on any well-known computer system, such 
as a personal computer. 
5 It should also be noted that the present invention implemented in a 

combination of software and/or hardware is not limited to devices which are 
physically connected and/or located within the same physical location. One or 
more of the devices illustrated in FIG. 1 can be located remotely and can be 
connected via a wireless connection. 

10 A digital image includes one or more digital image channels. Each 

digital image channel includes a two-dimensional array of pixels. Each pixel 
value relates to the amount of light received by the image capture device 10a 
corresponding to the geometrical domain of the pixel. For color imaging 
applications a digital image will typically consist of red, green, and blue digital 

15 image channels. Other configurations are also practiced, e.g. cyan, magenta, and 
yellow digital image channels. Motion imaging applications can be thought of as 
a time sequence of digital images. Those skilled in the art will recognize that the 
present invention can be applied to, but is not limited to, a digital image channel 
for any of the above mentioned applications. Although the present invention 

20 describes a digital image channel as a two dimensional array of pixel values 
arranged by rows and columns, those skilled in the art will recognize that the 
present invention can be applied to mosaic (non rectilinear) arrays with equal 
effect. 

The digital image processor 20 shown in FIG. 1 is illustrated in 
25 more detail in FIG. 2. The general form of the digital image processor 20 
employed by the present invention is a cascaded chain of image processing 
modules. A source digital image 101 is received by the digital image processor 20 
which produces on output an enhanced digital image 102 and a local noise 
characteristic table 105, i.e. a table of noise characteristic values. A noise 
30 estimation module 110 receives the source digital image 101 and produces the 



local noise characteristic table 105. Each image processing module contained 
within the digital image processor 20 receives a digital image, modifies the digital 
image, produces a processed digital image and passes the processed digital image 
to the next image processing module. The two enhancement transform modules 
shown within the digital image processor 20 are a noise reduction module 22 and a 
spatial sharpening module 23. These two modules use the local noise 
characteristic table 105 produced by the noise estimation module 1 10 to produce 
the enhanced digital image 102. Those skilled in the art will recognize that the 
any other image processing module that utilizes a noise characteristic table can be 
used with the present invention. 

The noise estimation module 110 shown in FIG. 2 is illustrated in 
more detail in FIG. 3. The source digital image 101 includes pixels corresponding 
to one or more different colors and typically includes three digital image channels 
that have pixels corresponding to red, green, and blue colors. The residual 
transform module 120 receives the source digital image 101 and uses a spatial 
filter and the pixel data of the source digital image 101 to calculate a residual 
digital image 107, i.e. a residual pixel value corresponding to each original pixel 
value in the source digital image 101 . Thus the residual digital image 107 
includes pixels having pixel values corresponding to the one or more different 
colors of the source digital image 101. A residual statistics accumulator 130 
receives the residual digital image 107 and calculates a set of residual histograms 
from the residual digital image 107. A noise table calculator 140 receives the set 
of residual histograms and produces an noise characteristic table 105. 

The residual transform module 120 performs a spatial filtering 
operation on the pixel data of the source digital image 101 . That is, a residual 
pixel value is generated for each pixel of interest in the source digital image 101 . 
In general, all or nearly all of the pixels of the source digital image 101 are 
selected as pixels of interest. However, it is important to note that the present 
invention can be practiced using a subset of the pixels of the source digital image 
101 and still produce accurate noise characteristic tables. For each pixel of 
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interest, a collection of pixel values sampled in a local region about the pixel of 
interest is used to calculate two or more noise-free pixel estimates for the pixel of 
interest. A final noise-free pixel estimate is chosen based on a particular criterion 
and is then subtracted from the original pixel of interest to obtain a residual pixel 
5 value. The residual transform module 120 performs the spatial filtering operation 
on each color digital image channel individually and forms a residual pixel value 
for each pixel of each color digital image channel. That is, the spatial filtering 
operation of the red pixel values does not use the green pixel values and vice 
versa. The process is described mathematically below. 
10 Let g(x,y) describe the array of pixel value corresponding to a 

individual color digital image channel of the source digital image 101. Assuming 
an additive noise source, g(x,y) can be defined in terms of a noise component 
n(x,y) and the signal component f(x,y): 

15 g(x,y) = f(x,y) + n(x,y) (1) 

An estimate of the signal component f(x,y) is obtained using a spatial filter. The 
noise component n(x,y) is then obtained by computing the difference between 
g(x,y) and the signal component f(x,y). The effectiveness of the overall noise 

20 estimation process depends largely on the effectiveness of the spatial filter used. 
The better the approximation of f(x,y), the better the estimate of the noise 
component n(x,y). Ultimately, the goal is to produce a noise component (the 
residual digital image 107), n(x,y), that is composed exclusively of noise. That is, 
there should be no image structure signal content in the residual digital image 107. 

25 The preferred embodiment of the present invention uses a linear 

spatial filter applied in four directions in a local region about the pixel of interest: 
at 0, 90, 45, and 135 degrees. These four directions correspond to pixels sampled 
about the pixel of interest along a line centered in the local region about the pixel 
of interest. The linear spatial filter uses a linear combination of the neighboring 
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pixels in accordance with a cubic relationship to calculate a noise free pixel 
estimate. The coefficients for the cubic linear spatial filter are given below: 

[-1/6 2/3 0 2/3 -1/6] (2) 

5 

The linear spatial filter is applied to the neighboring pixels for the four directions 
listed above thus producing four noise free pixel estimates for the pixel of interest. 
The linear spatial filter described in equation (2) has a zero coefficient for the 
pixel of interest. Thus the noise free pixel estimates produced with the linear 

10 spatial filter are independent from the value of the pixel of interest. 

The final noise free pixel estimate is chosen based on the minimum 
absolute difference between each noise free pixel estimate and the value of the 
pixel of interest, i.e. the noise free pixel estimate that is closet in value. The pixels 
sampled in a local region about the pixel of interest used to obtain the four 

15 estimates are shown in FIG. 4. The pixels labeled A constitute the 0 degree 

orientation, the pixels labeled B constitute the 90 degree orientation, and the pixels 
labeled C and D constitute the 45 and 135 degree orientations, respectively. Each 
set of pixels A, B, C and D would be multiplied by the coefficients of the filter 
shown in equation 2. 

20 The spatial filtering technique described above can be used for noise 

estimation and noise removal. As described hereinbelow, the final noise free pixel 
estimate is subtracted from the pixel of interest to form a noise residual image 
from which an estimate of the noise content can be derived. The present invention 
also uses the spatial filtering technique to form an enhanced digital image from the 

25 final noise free pixel estimate values. 

Let x represent the value of the pixel of interest and yj, i=l,2,... ,4, be the 
four noise free pixel estimates obtained using the spatial filter, and x represent the 
final noise free pixel estimate. The final noise free pixel estimate is chosen using 
the following criterion: 



30 



-9- 



x=mm\x-yi\ (3) 

i 

It is important to note that while the present invention uses the minimum absolute 
difference criterion to establish which pixel estimate is closest in value to the pixel 
5 of interest, those skilled in the art will recognize that other criteria, such as the 
second closest numerical estimate, can be used to produce similar results. 

The noise component n(x,y) is obtained by rearranging equation 

(l)as: 

10 n(x,y) = g(x,y) - f(x,y) (4) 

Thus the noise residual image 107 is obtained by subtracting the final noise free 
pixel estimates from the values of the corresponding pixels of interest. 

Those skilled in the art will recognize that other spatial filters can 

15 be used. For example, a linear filter that implements a linear combination of 
lower degree than the aforementioned cubic approximation can also be used to 
obtain the noise free pixel estimates. Similarly, those skilled in the art will 
recognize that fewer than four and greater than four noise free pixel estimates can 
be used with the present invention to produce good results. For example, pixels 

20 aligned along other directions can be used other than the four directions described 
in the preferred embodiment. Experimentation has shown that for some types of 
imagery more noise free pixel estimates can have an advantage. However, for a 
wide range of digital images obtained in digital imaging systems the cubic 
approximate linear filter applied in four directions provided accurate results while 

25 not requiring excessive numerical computation. 

The pixel data of the source digital image 101 can be 
conceptualized as having two components - a signal component relating to 
photographed objects f(x,y) and a noise component n(x,y). The resulting residual 
pixel values have statistical properties that have a closer relationship to the noise 
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component of the pixel data of the source digital image 101 than the signal 
component. Although the noise component can contain sub-components, the 
stochastic sub-component of the noise component is well modeled by a zero mean 
Gaussian probability distribution function. To first order, the noise component of 
the pixel data of the source digital image 101 can be characterized by a standard 
deviation and a mean value of zero. To second order, standard deviation of the 
noise component can be modeled as being signal strength and color dependent. 

Referring to FIG. 3, a residual statistics accumulator 130 analyzes 
the residual pixel values and records these values in the form of a set of residual 
histograms as a function of the color digital image channel and pixel value. 
Therefore a given residual histogram H ik relates to the i th color digital image 
channel and the k th pixel value sub-range. For each pixel of interest denoted by 
P™ (corresponding to the m* row and n* column location) in the processed color 
digital image channel, a histogram bin index k is computed. For example, if the 
numerical range of pixel values is from 0 to 255 there can be as many as 256 
useful histograms, i.e. one histogram for each possible numerical pixel value. In 
general, most noise sources can be characterized as having noise standard 
deviations that are slow functions of the pixel value. Therefore, the preferred 
embodiment of the present invention uses 8 histograms to cover the numerical 
pixel value range of 0 to 255. Thus the calculated histogram index bin and the 
corresponding sub-range pixel values are given by the following Table (1). 
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Table (1) 



histogram bin index 


sub-range pixel values 


average pixel value 
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144 
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176 
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192 to 233 


208 


7 


234 to 255 


240 



Those skilled in the art will recognize that the present invention can be practiced 
with digital image pixel data with any numerical range. The number of residual 
5 histograms used for each color digital image channel will depend on the accuracy 
of results required for the particular digital imaging application. 

Although each approximate residual histogram records statistical 
information for a range of pixel values for a given color digital image channel, the 
residual histogram records the frequency of residual pixel values associated with 

10 each pixel of interest p^. Since the expected mean of the distribution of residual 
pixel values is zero, the residual pixel values exhibit both positive and negative 
values. Therefore, the approximate residual histogram must record the frequency, 
i.e. the number of instances of residual pixel values, of all possible instances of 
residual pixel values. For the example above, the residual pixel values can range 

15 from -255 to +255. While is possible to construct local residual histograms with 
as many recording bins as there are possible instances of residual pixel values, in 
general it is not necessary. For most digital images only a small percentage of 
residual pixel values exhibit values near the extremes of the possible range. The 
present invention uses 101 total recording bins for each residual histogram. On of 

20 the recording bins corresponds to residual pixel values of 50 and greater. 
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Similarly, one other recording bin corresponds to residual pixel values of -50 and 
lower. The other 99 recording bins each correspond to a single residual pixel 
value for the numerical range from -49 to +49. 

Referring to FIG. 3, the noise table calculator 140 receives the set 
of residual histograms and calculates a noise characteristic table. For each of the 
residual histograms relating to a particular color digital image channel and pixel 
value range, the noise table calculator 140 derives a noise standard deviation value 
from the value of the recording cells of the updated residual histogram. The 
preferred embodiment of the present invention uses equation (5) to calculate the 
standard deviation value a n 

a n = ((1/N) S k RC v (k) (x-x m ) 2 ) 1/2 (5) 

where the variable x represents the average pixel value of the residual pixel values 
accumulated in the k ,h recording cell as given by Table (1) and RCv(k) represents 
the number of residual pixel values accumulated by the k tt recording cell. 

x = V(k) (6) 

The variable represents the arithmetic mean value of the corresponding residual 
pixel values given by equation (4) and , 

x m = (1/N) 2 k x (7) 

and the variable N represents the total number of residual pixel values recorded by 
the updated residual histogram given by equation (8). 



N = S k RC v (k) 



(8) 



10 
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An alternative embodiment of the present invention performs an 
alpha-trimmed standard deviation calculation. In this embodiment a first 
approximation to the standard deviation cr e is calculated using the method 
described above. The calculation of cr n is then calculated using the only recording 
cells with corresponding residual pixel values that are within a limited range of 
zero. The formula for the standard deviation calculation cr n is given by equation 
(9) 

a n = ((1/N) S k yRC v (k) (x - xj 2 ) ,/2 (9) 
where the variable y is given by equation (10) 

y = 1 if |x|<cco- e ^ (10) 

y — 0 if | x | >= a cr e 



where the variable a is set to 3.0. This alternative embodiment of the present 
invention is more computationally intensive than the preferred embodiment but 
15 does yield more accurate results via the rejection of out-lying residual pixel values 
from adversely contributing to the calculation of the standard deviation a n value. 

Table 2 below is an example of an noise characteristic table 
produced with the present invention. 
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5.01 
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7.31 


9.50 


208 


4.73 


6.15 


7.99 


240 


4.19 


5.45 


7.08 



Those skilled in the art should recognize that the present invention can be 
practiced with calculated quantities other than the standard deviation that relate to 
5 the noise present in digital images. For example, the statistical variance or 

statistical median can also be derived from the residual histograms and be used to 
form a table of noise characteristic values. As can be seen from Table 2, the noise 
characteristic value is reported as a function of the average numerical values of the 
source digital image pixels — i.e. the light intensity values represented in the 

10 source digital image. In addition, if the source digital image contains two or more 
color channels, the noise characteristic values can also be reported as a function of 
these color channels (as is the case in Table 2). 

The accuracy of the noise characteristic value estimates yielded by 
the present invention can be improved with additional refinement of the residual 

15 pixel values. For example, if the source digital image contains two or more color 
channels, the residual pixel values for the two or more color channels can be used 
to calculate a color weighting factor. This color weighting factor can then be used 
to exclude residual pixel values from the calculation of the noise characteristic 
value. Those skilled in the art will note that this type of refinement is well 

20 documented in the literature and could easily be combined with the present 
invention. 



-15- 

The present invention uses a set of residual histograms to record 
the calculated statistics. A set of histograms is an example of a statistical table 
from which a noise characteristic table can be derived. Thus the set of residual 
histograms constitutes a statistical table. Those skilled in the art should recognize 
that the present invention can be practiced with other forms of statistical tables. 
For example, the residual digital images can be stored and serve as a statistical 
table. 

The calculated noise characteristic table is used in conjunction with 
spatial filters for the purpose of enhancing the source digital image 101 and thus 
produce an enhanced digital image 102. A spatial filter is any method which uses 
pixel values sampled from a local region about a pixel of interest to calculate an 
enhanced pixel value which replaces the pixel of interest. Those spatial filters 
which reduce spatial modulation, for at least some pixels in an effort to remove 
noise from the processed digital image, can be considered noise reduction filters. 
Those spatial filters which increase spatial modulation, for at least some pixels in 
an effort to enhance spatial detail noise in the processed digital image, can be 
considered spatial sharpening filters. It should be noted that it is possible for a 
single spatial filter to be considered both a noise reduction filter as well as a 
spatial sharpening filter. The present invention can be used with any digital image 
processing method which makes uses of a noise characteristic table to produce an 
enhanced digital image 102. Spatial filters that adjust a processing control 
parameter as a function of either the color or numerical value of pixels are 
adaptive spatial filters. The present invention uses a noise reduction filter and a 
spatial sharpening filter which are responsive to a noise characteristic table. 

Referring to FIG. 2, the preferred embodiment of the present 
invention employs a noise reduction module 22 as part of the image processing 
method to produce enhanced digital images 102. As such, the source digital 
image 101 and the noise characteristic table 105 are received by the noise 
reduction module 22 which produces on output a noise reduced digital image. 
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It is important to note that for many practical digital imaging image 
systems, other image processing processors need to be included. As long as these 
other image processing processors accept a digital image as input and produce a 
digital image on output, more of these type of image processing modules can be 
5 inserted in the image processing chain in between a noise reduction module 22 
and a spatial sharpening module 23. 

The present invention uses a modified implementation of the Sigma 
filter, described by Jong-Sen Lee in the journal article Digital Image Smoothing 
and the Sigma Filter, Computer Vision, Graphics, and Image Processing Vol 24, 

10 p. 255-269, 1983, as a noise reduction filter to enhance the appearance of the 
processed digital image. The values of the pixels contained in a sampled local 
region, n by n pixels where n denotes the length of pixels in either the row or 
column direction, are compared with the value of the center pixel, or pixel of 
interest. Each pixel in the sampled local region is given a weighting factor of one 

15 or zero based on the absolute difference between the value of the pixel of interest 
and the local region pixel value. If the absolute value of the pixel value difference 
is less or equal to a threshold s, the weighting factor if set to one. Otherwise, the 
weighting factor is set to zero. The numerical constant s is set to two times the 
expected noise standard deviation. Mathematically the expression for the 

20 calculation of the noise reduced pixel value is given as 

qm„= ay p ;j /2 8 ay (11) 

and 

% = 1 if I Pij - Pmn I <= s 

= 0 if iRj-P™, l> e 
25 where p ;j represents the ij* pixel contained in the sampled local region, p m 
represents the value of the pixel of interest located at row m and column n, ay 
represents a weighting factor, and represents the noise reduced pixel value. 
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Typically, a rectangular sampling region centered about the center pixel is used 
with the indices i and j varied to sample the local pixel values. 

The signal dependent noise feature is incorporated into the 
expression for e given by equation (12) 

8= Sfaca n (pJ) (12) 

where a n represents the noise standard deviation of the source digital image 
evaluated at the center pixel value p,,,,, as described by equations (6) and (11) 
above. The parameter Sfac is termed a scale factor can be used to vary the degree 
of noise reduction. The optimal value for the Sfac parameter has been found to be 
1 .5 through experimentation however values ranging from 1 .0 to 3.0 can also 
produce acceptable results. The calculation of the noise reduced pixel value as 
the division of the two sums is then calculated. The process is completed for 
some or all of the pixels contained in the digital image channel and for some or all 
the digital image channels contained in the digital image. The noise reduced pixel 
values constitute the noise reduced digital image. The modified implementation 
of the Sigma filter is an example of a noise reduction filter that uses a noise 
characteristic table and is therefore an adaptive noise reduction filter which varies 
the amount of noise removed as a function of the pixel color and numerical value. 

Referring to FIG. 2, the preferred embodiment of the present 
invention employs a spatial sharpening module 23 as part of the image processing 
method to produce an enhanced digital image 102. As such, the noise reduced 
digital image and the local noise characteristic table 105 are received by the spatial 
sharpening module 23 which produces on output an enhanced digital image 102. 

Although the present invention can be used with any spatial 
sharpening filter which utilizes a priori knowledge of the noise characteristics, the 
preferred embodiment uses a modified implementation of the method described by 
Kwon et al in commonly-assigned U.S. Patent No. 5,081,692. This spatial 
sharpening method performs an unsharp masking operation by filtering the input 
digital image with a spatial averaging 2-dimensional Gaussian filter (characterized 
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by a standard deviation of 2.0 pixels) which results in a blurred digital image. The 
blurred digital image is subtracted from the input digital image to form a high-pass 
residual. In the method disclosed by Kwon et al. a local variance about a pixel of 
interest is calculated by using the pixel data from the high-pass residual. Based on 
5 the value of the local variance a sharpening factor is adjusted so as to amplify 
large signals more than small amplitude signals. The amplification factor (j> is 
therefore a factor of the local variance v. i.e. <j> (v). 

The present invention modifies the method taught by Kwon et al. to 
make the amplification factor (j> (v) a function of the estimated noise, i.e. <Kv,a n ). 
10 The amplification function f is given by a gamma function, or integral of a 
Gaussian probability function, as given by equation (13). 

y + y E e -( v - v *) 2/2s2 

J,/\,,\ J o J ma x ^ 

* ( } v Tv - v V/2s 2 (13 > 

v + v 2^ e \ v max - v 0 j /zs 

Jo y max ^ 

where y Q represents a minimum amplification factor y m ax represents a maximum 
amplification factor, v max represents a maximum abscissa value of the variable v, 
1 5 v Q represents a transition parameter and s represents a transition rate parameter. 
The variable v Q is a function of the noise standard deviation value a n as per 
equation (14) 

v 0 = Sfac 2 a n (p mn ) (14) 
where the scaling factor Sfac2 determines the sensitivity of the sharpening 

20 sensitivity to the noise and the noise standard deviation value o-„ is as described 
above in equations (6) and (11). The optimal values for the variables used in 
equation (14) depend on the digital imaging application. The present invention 
uses a value of 1 .0 for y 0 which results in no spatial sharpening for noisy regions. 
A value of 3.0 is used for y max , however, this variable is sensitive to user 

25 preference with values ranging from 2.0 to 4.0 producing acceptable results. The 
value of Sfac2 should be set to between 1 .0 and 2.0 with 1.5 as optimal. The 
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variables should be set to values in the range from v c / 2 to v G / 10 for reasonable 
results. The variable v max should be set to a value much larger than the expected 
noise, e.g. 20 time the value of cr n . 

While the preferred embodiment of the present invention calculates 
a noise characteristic table and then subsequently uses the noise characteristic 
table to produce an enhanced digital image, some digital imaging systems can be 
configured to separate the calculation phase from the enhancement phase. In an 
alternative embodiment of the present invention, the calculated noise characteristic 
table is stored with the source digital image 101 as meta-data, i.e. non-pixel 
information. The source digital image 101 with meta-data can be transmitted to a 
remote site or stored for safe keeping to be used at a later time or another site. 
Any of the above mentioned noise characteristic tables can be stored as meta-data. 
In general a noise characteristic table requires much less memory storage than a 
set of residual histograms. However, a set of residual histograms can be stored 
with the source digital image 101 as meta-data. 

The present invention uses a spatial filter to calculate a residual 
digital image 107 form a source digital image 101 and derives noise characteristic 
values from the residual digital image 107. Those skilled in the art will recognize 
that the present invention can be used in conjunction with spatial masking 
techniques, such as the method described by Snyder et al. in commonly-assigned 
U.S. Patent No. 5,923,775, to improve the statistical accuracy of the method. 

The four direction spatial filter described above can be used as a 
noise reduction filter. In this embodiment of the present invention, the final noise 
free pixel estimates are calculated for each pixel in the source digital image 101. 
The final noise free pixel estimates therefore forms a noise reduced digital image, 
i.e. a representation of the source digital image 101 with noise removed. An 
advantage of the present invention over other noise reduction method is the fact 
that the present invention does not require a priori knowledge of the noise 
characteristics of the source digital image 101. 
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The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 
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PARTS LIST 



10a 


image capture device 


10b 


image capture device 


10c 


image capture device 


20 


digital image processor 


22 


noise reduction module 


23 


spatial sharpening module 


30a 


image output device 


30b 


image output device 


40 


general control computer 


50 


monitor device 


60 


input control device 


70 


offline memory device 


101 


source digital image 


102 


enhanced digital image 


105 


local noise characteristic table 


107 


residual digital image 


110 


noise estimation module 


120 


residual transform module 


130 


residual statistic accumulator 


140 


noise table calculator 



